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Version Date Author Comments 
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Written based on my interpretation of Ben's brain dump. Still 
needs attachments for ZML DTD and list of supported 
elements of HTML and WML 
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1 Overview 

Handspring's BlueSky mobile application server includes two main components, an HTTP proxy server 
module (proxy) and a content transformation module (CTM). The proxy is a generic HTTP proxy that 
accepts requests for Web pages from the Blazer client and passes those requests on to remote Web servers. 
Once Web content is returned to the proxy from those remote Web servers, it is dynamically run through a 
series of transformations on the CTM, then transformed content is streamed back to the Blazer client. 
These two modules are further described below. 

2 Purpose 

The BlueSky mobile application server provides users of mobile devices with the ability to view a wide 
variety of Web content. Currently, the majority of Internet content is designed to be viewed on desktop 
computers. Most mobile devices differ dramatically from desktop computers with regard to screen size, 
processor power, and color capabilities. The BlueSky server optimizes Web content to improve the 
wireless Web experience for users of mobile devices. First, the proxy server acts as a connected agent on 
behalf of mobile users, storing important personal and account information and managing much of the 
"heavy lifting" that would slow down Web access in the absence of the proxy. To augment the value of the 
proxy, the CTM optimizes pages designed for desktop use to viewing on a smaller screen device. 

3 Content Transformation Module (CTM) 

The purpose of the CTM is to optimize Web content for viewing on a small screen device. The CTM 
adapts content to the screen size and display capabilities of the device. Currently, this adaptation is geared 
toward screens that measure 160x160 pixels and to devices that run on the Palm operating system [is there 
anything specific to Palm OS in the CTM?] 

The CTM actually consists of a series of discrete transformations that convert Web documents and images 
to formats that are understandable to a Palm OS device running the Blazer browser. Those transformations 
include transcoding HTML, HDML, WML and cHTML documents to "ZML" and adapting images to meet 
the device capabilities. The following is a description of those processes. 

3.1 Transcoding: HTML, HDML, WML, & cHTML to 
"ZML" 

The CTM transcodes documents from several markup languages to "ZML," a language unique to Blazer 
that is a superset of WML. 

3.1.1 "ZML" 

Blazer natively displays documents marked up in "ZML," a language unique to Blazer that is a superset of 
WML. ZML supports all elements in the WML 1.1 specification, including Phone.com (now OpenWave) 
language extensions. In addition, ZML also supports additional extensions that optimize support for 
HTML pages. Following is a list of the extensions supported by ZML [Need to fill in list]: 





Elements 


Attributes 


Description 


phone.com 


<link> 






phone.com 


<spawn> 






phonexom 


<exit> 






phone.com 


<catch> 






phone.com 


<throw> 








<hr> 




inserts a horizontal line 




<base> 
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3.1 .2 HTML or cHTML to ZML 

The majority of pages accessed by most Blazer users are HTML pages. HTML pages go through a series 
of steps as they are transcoded to ZML pages. These steps are outlined below: 

3.1 .2.1 Step One: Convert HTML to valid, well-formed XML 
document 

The first step in the transcoding of HTML to ZML is to convert the HTML into a valid, well-formed XML 
document. To do this, the CTM uses a generic algorithm to "normalize" the markup language to ensure 
that the HTML document conforms to the HTML Document Type Description (DTD). During this 
process, the CTM "fixes" HTML that does not conform to the DTD. Well-formed XML documents must 
include the following (from URL: http://www.ucc.ie/xml/): 

• All tags must be balanced: that is, all elements which may contain character data must have both start- 
and end-tags present (omission is not allowed except for empty elements, see below); 

• All attribute values must be in quotes (the single-quote character [the apostrophe] may be used if the 
value contains a double-quote character, and vice versa): if you need both, use &apos; or &quof, (do 
not under any circumstances use the typographic (curly) 'inverted commas' for quoting attribute 
values); 

• Any EMPTY element tags (e.g. those with no end-tag like HTML's <IMG>, <HR>, and <BR> and 
others) must either end with 7>' or you have to make mem appear non-EMPTY by adding a real end- 
tag; Example: <BR> would become either <BR/> or <BRX / BR>. 

• There must not be any isolated markup-start characters (< or &) in your text data (ie they must be 
given as < and &), and the sequence ]]> must be given as ]]> unless you really are using it 
as the end of a CDATA marked section; 

• Elements must nest inside each other properly (no overlapping markup, same rule as for all SGML, 
including HTML); 

• Well-formed documents with no DTD may use attributes on any element, but the attributes are 
assumed to be all of type CDATA. You cannot use ID/IDREF attributes in DTDless documents. 

In addition to using the generic algorithm to normalize the document, the CTM applies additional rules to 
manage special cases. These additional rules are outlined below [need details on additional rules]: 

3.1.2.2 Step Two: Strip out unsupported content 

Once the HTML has been converted to a valid, well-formed XML document, the CTM strips out content 
that cannot be supported by the Blazer browser. Supported content includes a subset of the HTML 3.2 
DTDandmeWMLl.lDTDmcludmgmePhone.com/OpenWaveextensions (see attached). Examples of 
elements that are not supported include: scripts (JavaScript, VBscript), Java applets, plug-ins (e.g. Flash, 
Shockwave, RealAudio) [I'm sure there are more here...] 

The list of elements and attributes that are supported is subject to change regularly. 

3.1.2.3 Step Three: Reformat content for layout on screen 

The CTM applies a number of rules to the content to optimize for viewing on a small-screen device. For 
example, die CTM strips out extra white space by removing extra line break tags (<BR>), changing line 
breaks to paragraph tags, stripping out empty paragraph tags, stripping out line break tags at the beginning 
or end of table cells, etc. In addition, the CTM unrolls large page-level tables and displays elements from 
within the table stacked (?) on a page. The CTM preserves certain nested tables that fit within the device 
screen constraints. [Not including farther details about this...trade secret :)] 



Handspring, Inc. CONFIDENTIAL Page 4 of 4 BlueSky FRD.doc, 6/14/2001 6/14/2001 



— >r # • 

handspring 

3.1 .2.4 Step Four: Convert to ZML 

To convert the valid, weMormed XML document to ZML, the CTM changes HTML tags to their 
equivalent ZML tags (WML + phone.com language extensions + additional extensions). For example, the 
header tags (<H1, H2, etc.) are not supported in ZML. In this case, the CTM changes the header tags to 
equivalent WML tags that display text big and bold (<hl>text</hl> to 
<bigxb>text</bx/big>). 

3.1 .2.5 Step Five: Convert ZML to ZML-C 

The ZML created by the CTM is then converted to binary (tokenized) ZML-C according to the 
specifications for WBXML before it is sent to the device. This compact binary representation of ZML 
reduces the transmission size of the document with no loss of functionality or semantic information. 

3.1.2.6 t Special treatment of sites identified as optimized for 
handheld devices 

Web pages that include meta tags designating them as optimized for handheld devices are treated 
differently. These pages are typically marked up in HTML and are geared toward users of Palm and 
PocketPC devices. They include the following tags in their headers: <ineta nam©= "HandheidFriendiy" 

contents "true " > or <met a name=PalmComputingPlatfona content =true>. 

\Q When parsing (?) handheld-friendly sites, the CTM preserves all tables unaltered (i.e. does not unroll 

ffl tables). It also converts certain types of URLs (found in Palm PQAs) to URLs that point to appropriate 

ill files on die content Web server. Lastly, the CTM converts certain elements used in PQA pages (DeviceED 

Id and %zipcode) to WML-style variables. 

3.1 .3 HDML & WML to ZML 

The CTM also converts HDML (pre-cursor to WML; still widely used for site compatibility with all 
phone.com UP browsers) to WML and WML to ZML. There are very few changes that happen during this 

S conversion as ZML is essentially WML with certain extensions. [What 's involved in converting HDML to 

u ; WML?] 

| 3.2 Images 

u In a parallel process, the CTM converts images into a format that is supported by the device. This process 

is currently geared toward Palm OS device screens and capabilities (e.g., screens with 160x160 pixels with 
7 pixel scrollbar, particular image bit depths). 

3.2.1 Scaling image height and width 

Currently, the CTM reduces the size of any image that exceeds 153 pixels in height or width. The image is 
scaled proportionally until the longer of the two dimensions is exactly 153 pixels. We anticipate that future 
versions of the CTM will apply additional intelligence to image scaling. For example, many Web sites 
place several images flush next to one another horizontally on the screen to represent a single image (e.g. a 
navigation bar). The CTM should recognize these images as linked and scale them all by the same factor 
so that they maintain their position on the screen. 

3.2.2 Reducing image bit depth; convert to Palm 
bitmap 

The CTM also converts the image to the bit depth that is supported by the device and specified by the user 
preference. This information is communicated to the CTM when the browser makes its request. Images 
are also converted from several formats (GIF, JPG, WBMP, PNG, BMP) to Palm bitmaps. 
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4 Proxy module 

The BlueSky proxy module is a generic HTTP proxy. It includes a few features that enhance the base 
functionality of an HTTP proxy, including establishing and verifying user account information, intercepting 
and storing cookies, handling server redirects, and enabling 128bit RSA security to secure remote Web 
sites. There is some possibility that we may opt to use a commercially available proxy for much of the base 
functionality and add support for user accounts, cookies, server redirects, and security to that product. 



4.1 User accounts 

The proxy requires a username and password to authenticate client devices. Users establish this username 
and password through an account setup on the Bluelark (later, Handspring) Web site. The username must 
be unique (in the future it will be email address) and the password must be an alphanumeric string greater 
than five characters. The username and password information is stored in an Oracle database and links the 
user to their stored cookies (see below). [Anything else?] 



4.2 Cookies 

The proxy module intercepts cookies that are sent from the remote Web server and stores them in an Oracle 
database. Typically, these cookies reside in a text file on the client device. There are several reasons that 
the proxy intercepts cookies. First, storing cookies on the server preserves valuable storage memory on the 
device. Second, if a user is forced to do a hard reset of their device, or if they use Blazer from another 
device or upgrade to a new device, this information continues to be available to them Third, storing 
cookies on the proxy provides for faster access to sites that require cookies. The server is able to attach 
individual user cookies to requests that need them. [What other reasons are there?] 



4.3 Server redirects 

The proxy module also handles server redirects for the browser to improve the speed of access to the 
desired Web page. Rather than send data to the browser and require the browser to re-request the page, the 
server handles this without notifying the browser. The proxy has a limit on the total number of sequential 
redirects of xx. 



4.4 Security 

The proxy provides HTTPS support for secure connections, offering 128 bit elliptical curve cryptography 
(ECC) between the client and the proxy server and RSA encryption between the proxy and the target Web 
site. The encryption is maintained through the data carrier network. Data is unencrypted on the proxy and 
reencrypted before it is sent to the client device. Security is maintained through physical and electronic 
means (firewall, fortress???) 



Handspring, Inc. CONFIDENTIAL Page 6 of 6 BlueSky FRD.doc, 6/14/2001 6/14/2001 



# 



APPENDIX E 



ADAPTING TO NETWORK AND CLIENT 
VARIATIONS USING INFRASTRUCTURE PROXIES: 
LESSONS AND PERSPECTIVES 



# # •+ 



ADAPTING TO NETWORK AND CLIENT 
VARIATION USING INFRASTRUCTURAL PROXIES: 
LESSONS AND PERSPECTIVES 



• • •# 



Adapting to Network and Client Variation Using Infrastructural 
Proxies: Lessons and Perspectives 

Armando Fox Steven D. Gribble Yatin Chawathe 
Eric A. Brewer 
{fox,gribble,yatin,brewer}@cs,berkeley.edu 



Today's Internet clients vary widely with re- 
spect to both hardware and software properties: 
screen size, color depth, effective bandwidth, pro- 
cessing power, and the ability to handle different 
data formats. The order-of-magnitude span of this 
variation is too large to hide at the network level, 
making application-level techniques necessary. We 
show that on-the-fly adaptation by transformational 
proxies is a widely applicable, cost-effective, and 
flexible technique for addressing all these types of 
variation. To support this claim, we describe our 
experience with datatype-specific distillation (lossy 
compression) in a variety of applications. We also 
argue that placing adaptation machinery in the net- 
work infrastructure, rather than inserting it into end 
servers, enables incremental deployment and amor- 
tization of operating costs. To this end, we de- 
scribe a programming model for large-scale inter- 
active Internet services and a scalable cluster-based 
framework that has been in production use at UC 
Berkeley since April 1997. We present a detailed ex- 
amination of TranSend, a scalable transformational 
Web proxy deployed on our cluster framework, and 
give descriptions of several handheld-device appli- 
cations that demonstrate the wide applicabiUty of 
the proxy-adaptation philosophy. 



1 Infrastructural On-the-FIy Adap- 
tation Services 

1.1 Heterogeneity: Thin Clients and 
Slow Networks 



of magnitude. High-volume devices such as smart 
phones [12} and smart two-way pagers will soon 
constitute an increasing fraction of Internet clients, 
making the variation even more pronounced. 

These conditions make it difficult for servers to 
provide a level of service that is appropriate for ev- 
ery client. Application-level adaptation is required 
to provide a meaningful Internet experience across 
the range of client capabilities. Despite continuing 
improvements in client computing power and con- 
nectivity, we expect the high end to advance roughly 
in parallel with the low end, effectively maintaining 
a gap between the two and therefore the need for 
application-level adaptation. 



Platform 


SPEC92/ 


Screen 


Bits/ 




Memory 


Size 


pixel 


High-end PC 


200/64M 


1280x1024 


24 


Midrange PC 


160/32M 


1024x768 


16 


Typ. Laptop 


110/16M 


800x600 


8 


Typical PDA 


Iow/2M 


320x200 


2 



Table 1: Physical variation among clients 



Network Bandwidth Round-Trip 

(bits/s) Time 

Local Ethernet 10-100 M 0.5 - 2.0 ms 

ISDN 128 K 10-20 ms 

Wireline Modem 14.4 - 56 K 350 ms 

Cellular/CDPD 9.6 - 19.2 K 0.1 - 0.5 s 

Table 2: Typical Network Variation 



The current Internet infrastructure includes an 
extensive range and number of clients and servers. 
Clients vary along many axes, including screen size, 
color depth, effective bandwidth, processing power, 
and ability to handle specific data encodings, e.g., 
GIF, PostScript, or MPEG, As shown in tables 1 
and 2, each type of variation often spans orders 



1.2 Approach: Infrastructural Proxy 
Services 

We argue for a proxy-based approach to adapta- 
tion, in which proxy agents placed between clients 
and servers perform aggressive computation and 
storage on behalf of clients. The proxy ap- 
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proach stands in contrast to the client-based ap- 
proach, which attempts to bring all clients up to 
a ieast-common-denominator level of functionality 
(e.g. text-only, HTML-subset compatibility for 
thin-client Web browsers), and the server-based ap- 
proach, which attempts to insert adaptation ma- 
chinery at each end server. We believe the proxy 
approach directly confers three advantages over the 
client and server approaches. 

• Leveraging the installed infrastructure 
through incremental deployment. The 

enormous installed infrastructure, and its at- 
tendant base of existing content, is too valuable 
to waste; yet some clients cannot handle certain 
data types effectively. A compelling solution to 
the problem of client and network heterogene- 
ity should allow interoperability with existing 
servers, thus enabling incremental deployment 
while evolving content formats and protocols 
are tuned and standardized for different tar- 
get platforms. A proxy-based approach lends 
itself naturally to transparent incremental de- 
ployment, since an application-level proxy ap- 
pears as a server to existing clients and as a 
client to existing servers. 

• Rapid prototyping during turbulent 
standardization cycles. Software develop- 
ment on "Internet time" does not allow for 
long deployment cycles. Proxy-based adapta- 
tion provides a smooth path for rapid proto- 
typing of new services, formats, and protocols, 
which can be deployed to servers (or clients) 
later if the prototypes succeed. 

• Economy of scale. Basic queueing the- 
ory shows that a large central (virtual) server 
is more efficient in both cost and utilization 
(though less predictable in per-request perfor- 
mance) than a collection of smaller servers; 
standalone desktop systems represent the de- 
generate case of one "server" per user. This 
supports the argument for Network Computers 
[28] and suggests that collocating proxy services 
with infrastructural elements such as Internet 
points-of-presence (POPs) is one way to achieve 
effective economies of scale. 

Large-scale network services remain difficult to 
deploy because of three fundamental challenges: 
scalability, availability and cost effectiveness. By 
scalability, we mean that when the load offered to 
the service increases, an incremental and linear in- 
crease in hardware can maintain the same per-user 



level of service. By availability, we mean that the 
service as a whole must be available 24 x 7, despite 
transient partial hardware or software failures. By 
cost effectiveness, we mean that the service must be 
economical to administer and expand, even though 
it potentially comprises many workstation nodes op- 
erating as a centralized cluster or "server farm 1 '. 
In section 3 we describe how we have addressed 
these challenges in our cluster-based proxy appli- 
cation server architecture. 

1.3 Contributions and Map of Paper 

In section 2 we describe our measurements and 
experience with datatype-specific distillation and re- 
finement, a mechanism that has been central to our 
proxy-based approach to network and client adapta- 
tion. In section 3 we introduce a generalized "build- 
ing block*' programming model for designing and 
implementing adaptive applications, describe our 
implemented cluster-based application server that 
instantiates the model, and present detailed mea- 
surements of a particular production application: 
TranSend, a transformational Web proxy service. In 
section 4 we present case studies of other services we 
have built using our programming model, some of 
which are in daily use by thousands of users, includ- 
ing the Top Gun Wingman graphical Web browser 
for the 3Com PalmPilot handheld device. We dis- 
cuss related work in section 5, and attempt to draw 
some lessons from our experience and guidelines for 
future research in section 6. 

2 Adaptation via Datatype Specific 
Distillation 

We propose three design principles that we be- 
lieve are fundamental for addressing client variation 
most effectively. 
1. Adapt to client variation via datatype- 
specific lossy compression. 
Datatype-specific lossy compression mecha- 
nisms can achieve much better compression 
than "generic" compressors, because they can 
make intelligent decisions about what informa- 
tion to throw away based on the semantic type 
of the data. For example, lossy compression 
of an image requires discarding color informa- 
tion, high-frequency components, or pixel res- 
olution. Lossy compression of video can addi- 
tionally include frame rate reduction. Less ob- 
viously, lossy compression of formatted text re- 
quires discarding some formatting information 



but preserving the actual prose. In all cases, 
the goal is to preserve information that has the 
highest semantic value. We refer to this process 
generically as distillation. A distilled object al- 
lows the user to decide whether it is worth ask- 
ing for a refinement for instance, zooming in 
on a section of a graphic or video frame, or ren- 
dering a particular page containing PostScript 
text and figures without having to render the 
preceding pages. 



2. Perform adaptation on the fly. To reap 
the maximum benefit from distillation and re- 
finement, a distilled representation must tar- 
get specific attributes of the client. The mea- 
surements reported in section 2.1 show that for 
typical images and rich-text, distillation time 
is small in practice, and end-to-end latency 
is reduced because of the much smaller num- 
ber of bytes transmitted over low-bandwidth 
links. On-demand distillation provides an easy 
path for incorporating support for new clients, 
and also allows distillation aggressiveness to 
track (e.g.) significant changes in network 
bandwidth, as might occur in vertical handoffs 
between different wireless networks [39]. We 
have successfully implemented useful distilla- 
tion "workers" that serve clients spanning an 
order of magnitude in each area of variation, 
and we have generalized our approach into a 
common framework, which we discuss in sec- 
tion 3. 



Move complexity away from both clients 
and servers. Application partitioning argu- 
ments have long been used to keep clients sim- 
ple [40]. However, adaptation through a shared 
infrastructural proxy enables incremental de- 
ployment and legacy client support, as we ar- 
gued in section 1.2. Therefore, on-demand dis- 
tillation and refinement should be done at an 
intermediate proxy that has access to substan- 
tial computing resources and is well-connected 
to the rest of the Internet. 



Table 3 lists the "axes" of compression corre- 
sponding to three important datatypes: formatted 
text, images, and video streams. We have found 
that order-of-magnitude size reductions are often 
possible without destroying the semantic content of 
an object (e.g. without rendering an image unrec- 
ognizable to the user). 



Semantic 
Type 

Image 



Text 



Video 



Specific 
encodings 
GIF, JPEG, 

PPM. 
Postscript 
Plain, HTML, 
Postscript, 
PDF 

NV, H.26L 
VQ, MPEG 



Distillation 

axes 
Resolution, 
color depth, 
color palette 
Richness (heavily 
formatted vs. 
simple markup 
vs. plaintext) 
Resolution, frame 
rate, color depth, 
progression limit 
(for progressive 
encodings) 



Table 3: Three important types and the dis- 
tillation axes corresponding to each. 

2.1 Performance of Distillation and Re- 
finement On Demand 

We now describe and evaluate datatype-specific 
distillers for images and rich-text. 1 The goal of this 
section is to support our claim that in the majority 
of cases, end-to-end latency is reduced by distilla- 
tion, that is, the time to produce a useful distilled 
object on today's workstation hardware is small 
enough to be more than compensated by the savings 
in transmission time for the distilled object relative 
to the original. 

2.1.1 Images 

" We have implemented an image distiller called gif- 
munch. which implements distillation and refine- 
ment for GIF [25] images, and consists largely of 
source code from the NetPBM Toolkit [35]. Figure 
1 shows the result of running gifrmmch on a large 
color GIF image of the Berkeley Computer Science 
Division's home building, Soda Hall. The image of 
Figure la measures 320 x 200 pixels — about 1 /8 the 
total area of the original 880 x 610— and uses 16 
grays, making it suitable for display on a typical 
handheld device. 

Due to the degradation of quality, the writing on 
the building is unreadable, but the user can request 
a refinement of the subregion containing the writing, 
which can then be viewed at full resolution. 

Image distillation can be used to address all three 
areas of client variation: 

• Network variation: The graphs in figure 2 

l A distiller for real-time network video streams is de- 
scribed separately, in [1]. 





Lett (a) is a distilled image of Soda Hall, and above (b) 
illustrates refinement (a) occupies 17 KB at 320x200 
pixels in 16 grays, compared with the 492 KB, 880x600 
pixel, 249 color original (not shown). The refinement (b) 
occupies 12 KB. Distillation took 6 seconds on a 
SPARCstation 20/71, and refinement took less than a 
second. 



Figure 1: Distillation example 
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Figure 2: End-to-end latency for images with and 
without distillation. Each group of bars represents 
one image with 5 levels of distillation; the top bar 
represents no distillation at all. The y-axis number 
is the distilled size in kilobytes (so the top bar gives 
the original size). Note that two of the undistilled 
images are off the scale; the Soda Hall image is off 
by an order of magnitude. 



age through gifraunch. 2 Each bar is segmented 
to show the distillation latency and transmis- 
sion latency separately. Clearly, even though 
distillation adds latency at the proxy, it can re- 
sult in greatly reduced end-to-end latency. This 
shows that on the fly distillation is not pro- 
hibitively expensive. 

Hardware variation: A "map to 16 grays" 
operation would be appropriate for PDA-class 
clients with shallow grayscale displays. We 
can identify this operation as an effective lossy 
compression technique precisely because we 
know we are operating on an image, regard- 
less of the particular encoding, and the com- 
pression achieved is significantly better than 
the 2-4 times compression typically achieved by 
u generic" lossless compression (design principle 

i Software variation: Handheld devices such 
as the 3Com PalmPilot frequently have built-in 
support for proprietary image encodings only. 
The ability to convert to this format saves code 
space and decoding latency on the client (de- 
sign principle #3). 



depict end-to-end client latency for retrieving 
the original and each of four distilled versions 
of a selection of GIF images: the top set of bars 
is for a cartoon found on a popular Web page, 
the middle set corresponds to a large photo- 
graphic image, and the bottom to a computer 
rendered image. The images were fetched using 
a 14.4Kb/s modem with standard compression 
(V.42bis and MNP-5) through the UC Berkeley 
PPP gateway, via a process that runs each im- 



2.1.2 Rich-Text 

We have also implemented a rich-text distiller that 
performs lossy compression of PostScript-encoded 

2 The network and distillation latencies reflect significant 
overhead due to the naive implementation of gifmunch and 
the latency and slow-start effects of the PPP gateway, respec- 
tively. In section 3 we discuss how to overcome some of these 
problems, but it is worth noting that end-to-end latency is 
still substantially reduced even in this naive prototype im- 
plementation. 



Feature 




Rich 
Text 


Post- 
Script 


Different fonts 


Y 


Y 


Y 


Bold and Italics 


Y 


Y 


Y 


Preserves Font Size 


head- 
ings 


Y 


Y 


Preserves Paragraphs 


Y 


Y 


Y 


Preserves Layout 


N 


Y 


Y 


Handles Equations 


N 


some 


Y 


Preserves Tables 


Y 


Y 


Y 


Preserves Graphs 


N 


N 


Y 



Table 4: Features for postscript distillation 



text using uses a third party postscript-to-text con- 
verter [34]. The distiller replaces PostScript format- 
ting information with HTML markup tags or with a 
custom rich-text format that preserves the position 
information of the words. PostScript is an excel- 
lent target for a distiller because of its complexity 
and verbosity: both transmission over the network 
and rendering on the client are resource intensive. 
Table 4 compares the features available in each for- 
mat. Figure 3 shows the advantage of rich-text over 
PostScript for screen viewing. As with image dis- 
tillation, PostScript distillation yields advantages in 
all three categories of client variation: 

• Network variation: Again, distillation re- 
duces the required bandwidth and thus the end- 
to-end latency- We achieved an average size 
reduction of a factor of 5 when going from 
compressed PostScript to gzipped HTML. Sec- 
ond, the pages of a PostScript document are 
pipelined through the distiller, so that the sec- 
ond page is distilled while the user views the 
first page. In practice, users only experience the 
latency of the first page, so the difference in per- 
ceived latency is about a factor of 8 for a 28.8K 
modem. Distillation typically took about 5 sec- 
onds for the first page and about 2 seconds for 
subsequent pages. 

• Hardware variation: Distillation reduces de- 
coding time by delivering data in an easy-to- 
parse format, and results in better looking doc- 
uments on clients with lower quality displays. 

• Software variation: PostScript distillation 
allows clients that do not directly support 
PostScript, such as handhelds, to view these 
documents in HTML or our rich-text format. 
The rich-text viewer could be an external 
viewer similar to ghostscript, an applet for a 



1.2 The Remote Queue Model 

Wt introduce 8emvt& g&tfatfls (RQ), 
vides a geciaal abstiactioa for low- level 
sistsofthxee basic elements. First, one o: 
receiving node. Second, an extents opera* 

that causes ctrgO through &r$& f followed 



Figure 3: Screen snapshots of our rich-text (top) 
versus ghostview (bottom). The rich-text is easier 
to read because it uses screen fonts. 

Java-capable browser, or a browser plug-in ren- 
dering module. 

Overall, rich-text distillation reduces end-to-end 
latency, results in more readable presentation, and 
adds new abilities to low-end clients, such as 
PostScript viewing. The latency for the appear- 
ance of the first page was reduced on an average 
by a factor of 8 using the proxy and PostScript 
distiller. Both HTML and our rich-text format 
are significantly easier to read on screen than ren- 
dered PostScript, although they sacrifice some lay- 
out and graphics accuracy compared to the original 
PostScript. 

2.2 Summary 

High client variability is an area of increasing con- 
cern that existing servers do not handle well. We 
have proposed three design principles we believe are 
fundamental to addressing variation: 

• Datatype-specific distillation and refinement 
achieve better compression than does lossless 
compression, while retaining useful semantic 
content and allowing network resources to be 
managed at the application level. 
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• When the proxy-to-client bandwidth is sub- 
stantially smaller than the proxy-to-server 
bandwidth (as is the case, e.g., in wireless net- 
works or with consumer wireline modems), on- 
demand distillation and refinement reduce end- 
to-end latency perceived by the client (some- 
times by almost an order of magnitude), are 
more flexible than reliance on precomputed 
static representations, and give low-end clients 
new abilities such as PostScript viewing. 

• Performing distillation and refinement in the 
network infrastructure rather than at the end- 
points separates technical as well as economic 
concerns of clients and servers. 



3 Scalable Internet Application 
Servers 

In order to accommodate compute-intensive 
adaptation techniques by putting resources in the 
network infrastructure, we must address two impor- 
tant challenges: 

1. Infrastructural resources are typically shared, 
and the sizes of user communities sharing 
resources such as Internet Points of Pres- 
ence (POP's) is increasing exponentially. A 
shared infrastructural service must therefore 
scale gracefully to serve large numbers of users. 

2. Infrastructural resources such as the IP routing 
infrastructure are expected to be reliable, with 
availability approaching 24 x 7 operation. If 
we place application-level computing resources 
such as distillation engines into this infrastruc- 
ture, we should be prepared to meet compara- 
ble expectations. 

In this section, we focus on the problem of deploy- 
ing adaptation-based proxy services to large com- 
munities (tens of thousands of users, representa- 
tive of the subscription size of a medium-sized In- 
ternet Service Provider). In particular, we discuss 
a cluster-friendly programming model for build- 
ing interactive and adaptive Internet services, and 
measurements of our implemented prototype of a 
scalable, cluster-based server that instantiates the 
model. Our framework reflects the implementation 
of three real services in use today: TranSend, a scal- 
able transformation proxy for the 25,000 UC Berke- 
ley dialup users (connecting through a bank of 600 
modems); Top Gun Wingman, the only graphical 



Web browser for the 3Com PalmPilot handheld de- 
vice (commercialized by ProxiNet); and the Inktomi 
search engine (commercialized as HotBot), which 
performs over 10 million queries per day against a 
database of over 100 million web pages. Although 
HotBot does not demonstrate client adaptation, we 
use it to validate particular design decisions in the 
implementation of our server platform, since it pi- 
oneered many of the cluster-based scalability tech- 
niques generalized in our scalable server prototype. 

We focus our detailed discussion and measure- 
ments on TranSend, a transformational proxy ser- 
vice that performs on-the-fly lossy image compres- 
sion. TranSend applies the ideas explored in the 
preceding section to the World Wide Web. 

3.1 TACC: A Programming Model for 
Internet Services 

We focus on a particular subset of Internet ser- 
vices, based on transformation (distillation, filter- 
ing, format conversion, etc.), aggregation (collecting 
and collating data from various sources, as search 
engines do), caching (both original and transformed 
content), and customization (maintenance of a per- 
user preferences database that allows workers to tai- 
lor their output to the user's needs or device char- 
acteristics) - 

We refer to this model as TACC, from the initials 
of the four elements above. In the TACC model, 
applications are built from building blocks intercon- 
nected with simple API's. Each building block, or 
worker, specializes in a particular task, for example, 
scaling/dithering of images in a particular format, 
conversion between specific data formats, extracting 
"landmark" information from specific Web pages, 
etc. Complete applications are built by composing 
workers; roughly speaking, one worker can chain to 
another (similar to processes in a Unix pipeline), or 
a worker can call another as a subroutine or corou- 
tine. This model of composition results in a very 
general programming model that subsumes trans- 
formation proxies [22], proxy filters [43], customized 
information aggregators, and search engines. 

A TACC server is a platform that instantiates 
TACC workers, provides dispatch rules for routing 
network data traffic to and from them, and pro- 
vides support for the inter-worker calling and chain- 
ing API's. Similar to a Unix shell, a TACC server 
provides the mechanisms that insulate workers from 
having to deal directly with low-level concerns such 
as data routing and exception handling, and gives 
workers a clean set of API's for communicating 
with each other, the caches, and the customization 



database (described below) . We describe our proto- 
type implementation of a scalable, commodity-PC 
cluster-based TACC server late 
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